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ABSTRACT,: 

This study examines the accuracy of the self-scoring 
efforts ot-isJOe eighth-graders on the Kuder General Interest Survey 
(GIS), and iyggests possible methods to improve self-scoring 
accuracy. ThtfGIS is widely used to assist junior high school 
students with their educational and vocational planning. After the 
administration of the test by English teachers (not aware of the 
research), the students' self-scored sections were checked for 
accuracy by an independent counter. Analysis results indicated 
sizable student error (94 counting errors were of magnitude 10 or 
more) that could definitely change the shape of a student's interest 
profile. Factors contributing to scoring error were not isolated. 
Suggestions for survey administrators to reduce self-scoring error 
include: provide adequate time; carefully' supervise the students' pin 
hole placements and scale use; have students recheck their counts; or 
use the machine scored version. (BS) 
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Abstract 

Selt-scoring efforts of 306 eighth-graders on the' Kuder Gener6.1 
Interest Survey vere found inaccurate. Scope, possible causes and 
suggestions for j^oxinselors are presented. 
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Self-Scoring Accuracy of the K\| ft|i ffiM Interest Sixrvgy 



A variety of instrunients have ^^^u^mHK to assist students 

with their educational and vocational pla!aii|C(E. The Kuder General 

Interest Survey (Kuder, 197^), GiS, is wicjL^ly used for this purpose, ■ 

with its author reco^mnending appli cat ions ?^jfct the ji^ior high school 

level. (Kuder, 1$75) A pop\ilar versioff}1te*^ the GIS is self-scored. 

Using this option, . studtents indicate their preferences by pin-punching 

holes in the answer sheet and on through a folded series of pages, 

which, when separated, yield charts for scoring the various scales 

' , • '' . ' « ■ 

of the GIS. Kuder 'himself warns that in the case of younger children,: 

scoring and profiling of scores should "be supervised closely because 

of possible errors I (1975) ?owever, a review of literature regarding 
I 

the GIS' and. its predecessor, the Kuder Preference Record— Vocational , 
Form C (Kuder, 19'*8), reveals a lack of research regarding the accuracy 
of the self-scoring procedure used. A serious problem, particularly ^ 
in light of the popularity of the. GIS, is that it« validity and relia- 
bility may be affected by self-scoring errors. The purpose of this 
article is to examine the accuracy of eighth-grade students* self- 
scoring efforts and to suggest possible methods of improving self- 
scoring accuracy. 

METHOD V 
Sample . , - 

There were 306 subjects^, in the study. This included 8lL1 eighth- 
grade students in a mid-Texas school except those placed in special 
MR or ED classes. ^ ^ ^ 



Self -Scoring 



Test Administration and Scoring Supervision 

« The school's three eighth-grade English teachers served as test 
administrators diiririg two regularly scheduled English periods. The 
teachers were giyen copies of the "Administration" and "Scoz^ing and 
Profiling" secticHis of the General Interest Survey Manual (Kuder, * 
1975). » along with a general explanation 'of the instrument by a 

school counselor. The tea6hers involved were not aware that the ^ 

i - ■ ■ " 

accuracy of the students' scoring was "being studied, nor ;were they 

aware that the results were being used in a research study. They were 
simply asked by the counselor to follow th^e manual's instructing. 
Verifgcation .of Scores 

Following the students' self-scoring, ^the self-scored sections 
of the surveys were collected and checked >f or accuracy by an* inde- 
pendent counter. Any discrepancies between a student 'Is obtained 
score an^ the counter's result were- re checked until a correct score 
was verified twice. To check the accuracy of the cdtin^^r's verifications,^ 
^% of the scores were rechecked by a third counterj No verification 
errors were found. 
ANALYSIS 

Magnitude of students ' . counting errors, was the variable in question. 
For each of the ten interest scales and a verification scale of the GIS, 
discrepancies between the students' obtained scores an^i the independent 
counter's results were computed. For each scale, the hypothesis tested 
with a one-tailed t-test was that t^ie S£tii5>le was drawn from a population 
•whose mean counting error magnitude is zero on that scale. A one-tailed 
/test was employed because use of magnitude of counting error, without 
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. ■concern for the sign of the error, elimlnatejl all" negative .values . 
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To describe the size and scope of errors,* a frequency distribution of 

• . ' ■ ' ' ' ^ e " '^^ ' . ^' . '^t^'"^' 

the counting- errors on each scale was developed* J ' . ^ ^ 

^REStlLTS*. ' . \ ■ .r^^ ^ . f ^ 

■ . : ■ ■ 'V ■ • ' ^ ' ^ ' ■ ^ . • ^ . . ■ 

t-tests ' , * ■ ; - ■ • ■ ' . *" • ' , , . ' 

* -rthe critical value for a one-tailed t. at •thtf .0005 level ot slg^; 
nlvioance, d.f. = oo , Is 3.291. -The obtained t for ^he' verlfldatipn 
scale was 4.47, and the bbtalned^t's for tfhe .10 Interest scales; ratiged 
from 5*.28*to 9.70* , Thus, the magnitudes 'of the counting errors;on " • 
all scales were „large enough fot ^statistical. significance at the ..Q005 
'•level^.- '* ,'i . , * ■' , . ■' ^ ' . ' . . . ' " ./ 

Frequency Distribution * ^ ^ ^ ' 

The' frequency pf , errors oJE each magnitude on each scale Is pre- 
sented In Xable!^ 1.' Fof'.example, on sca].e 1, fifteen subjects had a 
counting' error of three; and on^scal^ 4, one subject made a counting 
error of 35. / 
CONCLUSIONS 

The obvious conclusion which can be draxm from this study Is 
that many of the eighth-grade subjects were Inaccurate In their self- 
scorlng efforts on the GIS. An examination of the frequency data 
presented In Table 1 Indicates that sizable errors were made — 94 
counting errors were of magnitude 10 or more. , 

To emphasize the Implications of the lO-polnt errors mentioned 

» ' . - •* ■ 

above. Table 2 was constructed using percentile conversion data from 
the GIS Profile Section for boys, grade six through eight. (Kuder, 
1976) The table presents percentiles corresponding to raw scores 
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at the endpoints of ranges from five raw score points ,lDelow the 
approximate median to five raw score points above. For example, on 
scale Q, a raw score of 27 corresponds to a percentile of 51 (approxi- 
Plate median ) , and the ^0-point range centered on 27 corresponds to 
percentiles from 32 to 7l, a 39 percentile point difference. A . 
Similar analysis for- girls reveals percentile differences ranging 
from 26 to 36 points. A counting error of 10 could thus definitely 
cl^ge the shape of a student's interest profile. An even more drastic 
effect would occur if a student overcounted on one scaJ.e and under- 
(?bTinted on another, further magnifying the percentile difference. 
RECOMMENDATIONS - ' ^ • - ' 

Although no attempt was made in this stixdy to isolate factors 
which contributed to- the scccring -errors , suggestions x:an be made which . 
:possibly could reduce the problem. Below are. several such suggestions, 
centering primarily on actions of the sairvey administrator. 

Of course, the survey administrator should follow all directions 
and allow adequate time for completing and scoring the instrument. 
Student work ^ould be checked periodically to insure that the pin- 
holes are cajrefully ..being placed in the center of the space allowed, 
because a'* hole which is oftf the mark on the answer sheet is iaore easily 
misread on the scoring section pages. Also, a hole which is not punched 
clearly through all scoring sheets will be more easily overlooked 
during^ .counting. 

: ■ ■ / 

In addition, the administrator needs' to give careful attention to 
the procedure used by students to change a response. To retract an 
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already punched choice, the student is instructed to make two additional 
holes near the first, and any such triad is not \^ be counted during 
scoring. However, three holes, too close together on the answer sheet, 
sometimes blend into one large hole on the later scoring, sheets beneath, 
and some of the students in this study counted these large holes as one. 

The suggestion given in the GIS manual to have students hold their 
answer section up to the light should definitely be followed. , By doing 
this before the answer section is separated to reveal the scale scoring 
sections, students could identify and' correct potential problems caused 
"by incomplete hole punches or crowded triad corrections. 

Careful supervision is especially important on the pages where two 
scales are scored on overH^ing and crossing series of circles arid line 
segments. With the subjects in this study, several large errors were 
made on these pages because the student wrote the count for one scaJ.e 
in the space allocated for the other scale. Other students appeared tcA 
begin counting on one scale and transfer, either at a point of overlapping 
circles or crossing line segments, to the other scale measured oq the 
same page. " 

An obvious method of reducing student counting errors is for some-" 
one to recheck each count. On a large scale, this is too time 'consuming 
for one person; however, students could be» req.ulted to verify their 
own work by recounting until the sama count is 'obtained at least twice. 

A fin^Ll suggestion, in view of the number and size of errors made, 
is to use the machine^scored version of the GIS. Becaus/e of its * additional 
expense and time delay for score resiilts, plus the possibility that it 
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may be less intriguing- for students, the machine-scored option will 
not always replace the conventional version. Too, because of incom- 
plete erasures or stray marks or otherwise inappropriately completed 
answer sheets, .the machine-scored GIS will not eliminate scoring 

errors. . 

A noteworthy observation is that this study did not explore 
errors made during the students' efforts to construct an interest 
profile from the counted^scores. This prof iling involves tr^sferring 
numbers from the scoring pages to a separate page and then plotting 
these scores on a raw score /percentile chart. It is likely that 
transferring and incorrect plotting are further possible sources of 
err^ri* 

is hoped that this study will cause users of the self-scored 
version of the GIS to exercise considerable effort to reduce scoring . 
errors. A further, Hope is that these results will prompt similar 



studies with oth^r self-scored in3trume 
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TABLE 1 . 

» , . • , • . . 

Frequency of Counting Errors Of Various Magnitudes for Each GIS Scale 
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TABLE 2 

Mid-Range lO-Point Raw Score Differences and Cprrespondihg Percentiles 

• • - ■ ■ . ' ■ 

Scale 6aw Corresponding " Percentile Difference for 

Score Percentile 10-point Raw Score Difference 
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